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How Meltwater uses RabbitMQ 


Meltwater 
e Number of clusters across the whole company 


e Main data exchange mechanism 


Meltwater API 
e ~15 microservices 
e Half of them publishes / consumes messages to / from RabbitMQ 


e 2 RabbitMQ clusters: self managed and CloudAMQP 
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RabbitMQ + Elixir @ Meltwater API 


e amap elixir client 


e Our typical consumer setup: 


00000 


Long lived consumers 


Creating connection / channel and keeping it in a state 
Creating and binding a queue 
Deadletter setup 


Handling reconnections / consumer cancellations 


COD Meltwater 


Consequences 


e A lot of duplication and boilerplate 


e “Standards” diverging across our 
different projects 


defmodule Consumer do 
@behaviour GenRMQ.Consumer 


def init() do 
Is 
queue: "gen_rmq_in_queue", 
"gen_rmq exchange", 
routing_key: "#", 
Prefetch count: "10", 
uri: "amgp://quest:guest@localhost:5672" 
1 


Simplified end 





def consumer _tag() do 
Consumer Be aie 
end 


def handle message (tGenRMQ.Message{} = message) do 


GenRMQ. Consumer . ack (message) 
end 


GenRMQ.Consumer.start_link(Consumer, name: Consumer) 


Simplified 
Publisher 


defmodule Publisher do 
@behaviour GenRMQ.Publisher 


def init() do 
[ 
exchange: "gen_rmq_exchange", 
uri: "amqp://guest:guest@localhost:5672" 


GenRMQ.Publisher.start_link(Publisher, name: Publisher) 
GenRMQ. Publisher.publish (Publisher, "msg") 


Simplified Tests 


GenRMQ.RabbitCase - 
test helpers: 


e Test queue setup 

e Publish / consume test 
messages 

e Queue count / cleanup 


use GenRMQ.RabbitCase 


setup_all do 
{:ok, conn} = rmq open (@uri) 
:ok = setup out queue(conn, @out_queue, @exchange) 
{:ok, rabbit_conn: conn, out queue: @out_queue} 
end 


setup do 


purge_queues(@uri, [@out_queue]) 
end 


https://github.com/meltwater/gen_rm 
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Thank You! 
Q&A 


Looking for Elixir jobs in Berlin? We hire Juniors too! 
Influencer Content Team | API Team 
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